Goto

Collaborating Authors

 theorem 1


A 1/R Law for Kurtosis Contrast in Balanced Mixtures

Bi, Yuda, Xiao, Wenjun, Bai, Linhao, Calhoun, Vince D

arXiv.org Machine Learning

Abstract--Kurtosis-based Independent Component Analysis (ICA) weakens in wide, balanced mixtures. We also show that purification--selecting m R sign-consistent sources--restores R-independent contrast Ω(1/m), with a simple data-driven heuristic. Synthetic experiments validate the predicted decay, the T crossover, and contrast recovery. Independent Component Analysis (ICA) recovers statistically independent latent sources from linear mixtures and is identifiable whenever at most one source is Gaussian [1]. Excess kurtosis--the standardized fourth cumulant--is a central contrast function [9], and kurtosis-type nonlinearities remain standard in FastICA.



RDP_Sampled_Shuffle

Deepesh Data

Neural Information Processing Systems

Let = argm 2 CF ( )denote (2). T ( )+ log ( 1/ )+( 1) log ( 1/ ) log ( ) 1 , (5) where ( )isthe RDPof 2. Convergence:IfwerunAcldpwith t = DGpt, whereG2 = max{d1 Substitutingtheboundon4 into Lemma 2 together manipulationgivesproves Theorem 1; see Appendix E.2 fordetails.






Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension

Neural Information Processing Systems

While initial breakthroughs on the convergence of gradient optimization in neural networks (Li & Liang, 2018; Du et al., 2019a; Allen-Zhu et al., 2019) required unrealistic conditions on the